arXiv:1507.03364vl [math.NA] 13Jul2015 


Projection methods for ill-posed problems 
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Abstract 

The discretization of least-squares problems for linear ill-posed oper¬ 
ator equations in Hilbert spaces is considered. The main subject of this 
article concerns conditions for convergence of the associated discretized 
minimum-norm least-squares solution to the exact solution using exact 
attainable data. The two cases of global convergence (convergence for 
all exact solution) or local convergence (convergence for a specific exact 
solution) are investigated. We review the existing results and prove new 
equivalent condition when the discretized solution always converges to 
the exact solution. An important tool is to recognize the discrete solu¬ 
tion operator as oblique projection. Hence, global convergence can be 
characterized by certain subspaces having uniformly bounded angles. We 
furthermore derive practically useful conditions when this holds and put 
them into the context of known results. For local convergence we gen¬ 
eralize results on the characterization of weak or strong convergence and 
state some new sufficient conditions. We furthermore provide an example 
of a bounded sequence of discretized solutions which does not converge at 
all, not even weakly. 


1 Introduction 

We study the role of discretization in the use of solving ill-posed linear operator 
equations in Hilbert spaces. Consider an ill-posed problem in Hilbert spaces 

Ax = y, (1) 

where A : V —>■ V is continuous and equation m for solving x from given 
data y is ill-posed. In the following, N{A) and R{A) denote the nullspace and 
the range of an operator A, respectively. By we denote the pseudoinverse of 
A; cf., e.g., H- We symbolize norm-convergence by —>■ and weak convergence by 
We denote the weak limit by the symbol wHm, and, for a closed subspace 
Z, Az denotes the associated orthogonal projector onto Z. In the following, 
we assume (unless specified otherwise) the attainable case for problem ([T|), i.e., 
that y is in R{A). In this case, we can set y being the image of an element in 
V(A)-L. 

Ax"^ = y, x^ G N{A)-^. 

It is the unique element a;^, which we want to reconstruct from given data y. 
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We are interested in projection methods acting as a regularization, i.e., in 
approximating the pseudoinverse of A by solving discrete least-squares problems 
related to (ED- For this task we introduce discretizations in the spaces X and Y. 
Precisely, we assume given an increasing sequence of finite-dimensional spaces 
Xn C X and Ym CY, n,m € N, with the property 

^ncx„+i, ljx„ = x, r^cr^+1, = ( 2 ) 

n m 

For the discretization spaces we always denote the associated orthogonal pro¬ 
jector onto Xn hy Pn ■— and onto Y^ by Qm ■= 


Pn-.X^X, 


Qn 


Y^Yrr, 


The discretization of o by a general projection method involves the oper¬ 


ator 


An,m •— QmAPm 

and we define the associated solutions by (assuming attainability) 

^n.rr). •— A^ — A^^ ^Ax^ . 


(3) 


(4) 


It is well-known that Xn,m is the unique solution of minimum norm under all 
least-squares solutions of the projected problem, i.e., 

Xn,7n = argmin,^gx„ WQmAx - = argmin,jgx„ WQmAx - and 

Xn,m ^ X(^An^rn) 


It follows that A^n^ni = PnA\ n^Qm- The general projection method (|3]) embraces 
two special well-known methods: if we put formally m = oo, and hence Qm = d, 
we obtain the projected least-squares method involving 

Xn •— AnAx^, An = APn- ( 5 ) 


Conversely if we set n = oo and formally put n = oo, we obtain the dual 
least-squares method. 


(^oo,m ■— niAx\ 


— QmA, 


We distinguish these important special cases by labeling them with only one 
index for the first method and by the index oo, m for the second one. However, 
the dual least-squares method is not so much of interest for this paper (although 
it is of practical importance) as it always leads to a convergent method. 

It is clear that ^ is a bounded operator and hence Xn,m can be com¬ 
puted in a stable way. Moreover, the usual rules for ad joints and inverses hold: 
(A^ )* = (A* 1^ 

The immediate question that arises from this setup is, if Xn,m in m converges 
to x^ as n,m ^ oo, in what sense does this convergence happen, and for which 
x^ does this hold. 

More precisely, we study two different subjects: 

• Local convergence. Fix a;C Find conditions such that 


as n,m 


or 


as n, m —>■ oo . 
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• Global convergence. Find conditions such that 

Xn,m as n, m —>■ CXD e N{A)^. 

The second issue concerns convergence not only for one fixed but for all 

x'' G N(A)-^. 

Both questions are relevant for the general projection method (0]) and the 
projected least-squares method Note that the distinction between weak 
and strong convergence is not relevant for global convergence because the cor¬ 
responding conditions are identical [5]. 

Of course, these question have been discussed and partly answered in litera¬ 
ture, but often only for the projected least-squares method or even with further 
restriction like injective operators; see Section I2.1I for a review. It is observed 
that many authors in different articles use different conditions to prove conver¬ 
gence of a specific scheme, for instance, m or © below. The relation between 
different conditions in different papers is not always obvious. It is one of the 
purposes of this paper to clarify this situation and to unify the convergence con¬ 
ditions at best, to generalize known results to the general projection case using 
the operator ([3]) and hereby avoiding unnecessary assumptions like injectivity. 

Let us mention that the convergence of Xn,m to x^ is the most important 
requirement for the projection methods discussed here to act as regularization. 
The second one, the stability of the regularization, is automatically satisfied 
since we are dealing with finite-dimensional problems. Indeed, if convergence 
of Xn,m to cct is verified, it is not difficult to find error estimates for noisy data 
as well and with appropriate parameter choice rules (where the index of the 
approximation spaces n,m act as “regularization parameter”), convergence of 
Xn,m to a;t can be proven even for the case of noisy data. We do not dwell further 
on this matter since it can be treated by standard methods; for results on the 
noisy case or also nonlinear problems, see, e.g., [nisiiiiiiiiiaiiiiiiiiiniiia]; 
for combination with regularization, see e.g., [251 |30l [m |34]- For results with 
focus on the analysis of specific advanced method of choosing the discretization 
spaces (like adaptivity or multilevel-type), we refer to [T71IT511^ . 

This paper is organized as follows: in Section |21 we review existing conver¬ 
gence results and prove some important lemmas. In Section |3] we provide new 
conditions for global or local convergence and relate them to results in litera¬ 
ture. In Section U] we state a nontrivial example of a non-convergent sequence 
Xn,m which is bounded. We summarize with a conclusion in Section |S] 


2 Known and preliminary results 

In this section we give an extensive literature review of know results related to 
the questions raised in the previous section. Moreover, we present some lemmas 
needed later for the convergence analysis. 

2.1 A review of known resnlts 

The question of local or global convergence has, of course, been addressed in 
several articles. However, as stated above, quite often only injective operators, 
i.e., N{A) = 0, or the case of projected least-squares problems, i.e., Qm = I, 
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have been addressed. Moreover, although those results are useful, they are not 
always completely sharp. 

Before we come to the positive results, we remind of a well-known negative 
result of non-convergence. The following statement is the famous counterexam¬ 
ple of Seidman [S^ for the projected least-squares problem. 

Example 1 (Seidman). There exists a compact injective linear operator A and 
a such that Xn as given hy is a unbounded sequence. Thus, in particular, 
we have non-convergence Xn x’^. Moreover there also exists A,x^ as before 
such that Xn is bounded but Xn x"^. 

The operator used for this example is a diagonal operator in the /^-sequence 
space with a rank -1 perturbation: 

A-.t^^l^ A = diagipf) -\- jd ® e\, 

where 7 and j5 are appropriate sequences and e\ is the sequence with all 0 except 
at the first position, where it is 1. By an appropriate (constructive) choice of 
x'^ and / 3 , 7 , the unboundedness of Xn can be shown; see [35] or [Tj. The last 
statement in this theorem of a bounded (strongly-) non-convergence sequence 
is stated in [35] but not explicitly proven. 

Concerning the question of finding conditions for global convergence, the 
problem is well-studied. The following result is proven by Nashed [26], (for An), 
see also [57], in [^ Theorem 3.7] for An being injective, and for the general case 
with An,m by Du [5] (see also 0 )- It gives a necessary and sufficient condition 
for global convergence. 

Theorem 1. 

Xn,m —>■ as m,n ^ 00 \fx^ € N(A)^, 

if and only if there exists a constant C such that 

sup||A), ,„T|| < C. (6) 

n,m 

Below, we will also reprove the corresponding result (Theorem 11511 and, in 
particular, study characterizations of the uniform boundedness condition (|6]): 
see Theorems fTTlandfTSl 

Note that in [^ Theorem 2.6], Theorem [1] has been generalized to the case 
of nonatainable data, i.e., when y = Ax'^ i?(A)l. In this case the necessary 
and sufficient conditions for Xn being strongly (weakly) convergent to A^y is dSl) 
and A*nQny ^ 0 ^ At ^ (-)O. 

If follows immediately from Theorem [T] for the dual projection case, i.e., 
An,m = Aoo,m, by A]^ that condition ([BJ is always satisfied, i.e., 

this method always globally converges. This is well-known and has been shown, 

e.g., in [7]. 

A widely used sufficient condition for uniform boundedness and hence global 
convergence of Xn has been presented by Natterer m using a result by Nit- 
sche [53] . 

Theorem 2 (Natterer). Let A be injective. Suppose that there exists a con¬ 
stant C such that for all x^ € X there exists a Un € Xn ■ 

||a:t-«„|| + ||AtllllA(xt-u^)ll <C|]xt|l. (7) 

Then x„ —>■ xt as n —>• 00 for all xt e X. 
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In this theorem. 


Pnll = sup \\Xn\\ = CrJ^{APn). 

II \\—'i-,XnGX-n 

It is not difficult to verify that 0 implies (IH), We will generalize this result 
by giving a condition resembling o which is equivalent to m and hence yields 
global convergence in the general case (including non-injective operators and for 
the general projection case); see below Proposition [TOl 

Furthermore a quite general condition has been proposed by Vainikko and 
Hamarik m (see also [nnHns] and m and the references therein). 

Theorem 3 (Vainikko and Hamarik). Suppose that N(QmAPnA*) = {0}. If 
there is a constants C such that 

\\A*Q^APnz\\ < C\\PnA*QmAPnz\\ Vz G (8) 

then Xn,m x^ for all G N{A)^. 

Further results, e.g., on appropriate parameter choice rules, are proven in 
[55] as well. We will show below (Theorem [T51) that ([5]) is actually equivalent 
to (H]). 

A simple condition involving the product of the ill-posedness and approxi¬ 
mation rate has been used by several authors (e.g., [T9l|24]) 

Theorem 4. If \\A{I — Pn)||||Al „j|| < oo, then Xn,m x^ as m,n ^ oo for 
all a;! G N{A)^. If for a specific a;^, limj„_n,_>.oo ||A(/— Pri)a;^ || || „j|| = 0, then 

Xn,m —t a;’^ as m,n ^ oo. 

The previous results are ones that hold uniformly for all a;^ (except for the 
very last one), and convergence for all a;^ G N{A)-^ is obtained. However, it is 
of high interest to study conditions for convergence for one specific x\ when we 
do not care about global convergence. There are some statements concerning 
local convergence in literature. 

In a quite general situation, necessary and sufficient conditions for local 
convergence have been established by Groetsch and Neubauer [315]. 

Theorem 5 (Groetsch and Neubauer, also Du). We have the following local 
convergence conditions for strong convergence: 

Xn -t a;’’' limsup ||a;„|| < ||a;’''||. 

n 

Moreover, suppose that 


U(iV(A)nX„) = iV(A). (9) 


Then we have the following local convergence conditions for weak convergence: 

Xn x^ sup \\Xn || < OO. (10) 

n 
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Note that the part on weak convergence in Theorem [SJ identity (fTUl) is er¬ 
roneously stated in [312] without the space condition (|2|), as has been noted 
by Du |S]. The characterization of strong convergence is valid without m and 
was already stated in [5] (using the incomplete result for weak convergence). 
It has been rigorously proved by Du and Du (6] Remark 4.3]. We will extend 
Theorem [Sj to general projection methods with Xn,m] see Theorem 1251 

Besides the convergence result of Neubauer and Groetsch, a sufficient con¬ 
dition for strong local convergence without requiring information about has 
been stated by Luecke and Hickey Ell- 

Theorem 6 (Luecke, Hickey). Suppose that 

sup||(At)*a;„|| < oo, (11) 


then a;„ —>■ xb 

This result is also proven in [3 , where it is also explained that (HU is quite 
strong (and thus not a necessary condition for convergence) as it leads to a 
convergence rate of — xb In Proposition |27| we provide a similar result but 
by employing weaker conditions. 

A subtle and important point is the space condition (|9|). In case of injective 
operators, of course, m holds true but in the general case not always, not even 
if N{A) is finite-dimensional. (Think, for instance, of a discretization space Xn 
that is disjoint to N{A).) We note that {N{A) n Xn) is an increasing family of 
closed subspaces, thus the following identity holds, (cf., e.g., [121 Chpt. 1, § 12]) 

U(iV(A) n w„)^ = f|(iV(A) n x„)^, 

n n 

so that m is equivalent to 

f|(iV(A)nx„)^ = iV(A)^. (12) 

n 

A recent preprint [6] Theorem 1.1] discusses equivalent conditions to (|9|) 
(respectively, (jUj)). 

Theorem 7. The condition ([2|) is equivalent to each of the following conditions, 
Here Q{A) denotes the graph of an operator A. 

Vx S A^(A) : lim inf ||x —z„||—>-0, 

n->-oo z„eN(An) 


V(x,g) e g(A^) : lim inf ||(x,?/) - (z„,y„)|| ^ 0, 
(z„,w„)gG(aI,) 


• for all sequences ?/„; 

sup < oo and Vn ^ V V & T’(A'I') and A^y = A\y. 
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Moreover is equivalent to the following two conditions holding simultane¬ 
ously, ([H]) and gd.Y>{R{A* APn), APn) < 1, where the gap between two spaces 
M,N is defined as (see Lemma 3.2] gap(M,7V) = \\Pm — ^W||- 

We will extend the second part of this result and we show that ® can be 
equivalently be characterized as a certain angle (or gap) between subspaces (but 
not those in this theorem) to be smaller then one; cf. Lemma [TCI Moreover, we 
also study local convergence also when m is not satisfied. 

The subtle fact that boundedness of Xn is not enough for weak convergence 
and that an additional condition, e.g., like ®, is needed, is not very well- 
known. Du [51 Example 2.10] gave a counterexample of a sequence of ||a;„|| 
being uniformly bounded but which does not converge weakly to . 

Example 2 (Du). There exists a linear operator A and a x^ € N{A)-^ such 
that 

sup ||a:n|| < oo, 

n 

but Xn xfi In this example, however, converges strongly to some element 
x^. 

The operator in this counterexample is actually not ill-posed but a simple 
projection operator onto the complement of a one-dimensional subspace, A = 
I — (.,e)e with some appropriately chosen e. Failure of convergence happens 
because Xn converges (even strongly) but to the “wrong” solution. 

Below in Theorem 1281 we give a counterexample that is even more extreme: 
a situation like in the previous result. Example |2l but where the sequence 
does not converge at all (not even weakly). This example has been devised by 
Neubauer p5] . 

Example 3 (Neubauer). There exists a linear operator A and a x^ G N{A)^ 
such that 

sup ||a;„|| < oo, 

n 

but Xn does not converge weakly. 

Moreover, the sequence Xn has a subsequence, which converges weakly but 
with limit and no weakly convergent subsequence has limit xfi 

2.2 Preliminary lemmas 

Since Xn,Tn is always in N[An^m)^, it is important to study these spaces. We 
note that by discretization, An^m is an operator with closed range. We have the 
well-known duality relations, 

R{Al^„,)=N{An,n,)^ and N{Al^^) = R[An,m)^, (13) 

and all these spaces are closed. 

The following characterizations follow easily. 

Lemma 8. 

{,An,m) — G IC \x = Wn -f qn • G X.n H N(^QniAfi qn G } (1^) 

NiAn,m)^ ={xGXnn {N{QmA) H X„)^} 

= {x G : X = PnA QrnXnfi 
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Proof. The first identity m follows easily by a; = PnX + (/ — Pn)x. It is 
straightforward to proof that any x G Xn n (X„ fl N{QmA))^ is in N{An,m)^- 
Conversely, by taking either Wn or to be 0, it follows that any x G N{An^m)^ 


must be in both Xn and {Xn H N{QmA))-^. The last identity is (fT!Tll . □ 

Note that these spaces are not necessarily nested. However, the following 
inclusions can be verified: 

N{Q^A)r\Xn C N{QrnA) nXn+l C... N{QmA), (15) 

N{Q„,A)nXn D N{Qm+iA)nXn D... N{A)nXn, (16) 

NiA)nXn^f]{NiQ„,A)nXn). (17) 

m 


A simple consequence is that, for a fixed a;, the norm of the projection 
l|nAr(QmA)nx„a;||, is increasing in m (for fixed n) and decreasing in n (for fixed 
to). 

We now state some approximation results, namely that elements in N{A)^, 
i.e., the space where x^ lives, can be approximated arbitrary well by elements 
in the corresponding discrete space N{An,m)'^- 

Lemma 9. For all x G N{A)^ , 

lim inf lla: — z|| = lim inf lla: —z||=0, (18) 

n,m->oo zg/{(A* zgAr(A„,„)-L 

Proof. Let x G N{A)^ = R{A*) = R{A*A). Then for any e > 0 fixed, we can 
find a We such that 

||a: - A*We\\ < e,. 

Moreover by with e and We as before, we can find a no such that for all 
n > no and to > no 

\\PnA*We - A*We\\ < e, WQmWe - ’ 


thus. 


||cr - PnA*QmW,\\ < ||a: - PnA*w,\\ + \\PnA*{I - Q„,)w,\\ < 2e. 

which yields (fTSl) . Note that PnA*Qni'We is in i?(A*) = iV(A„)-*-. □ 

We remark that N{An,Tn)'^ is not necessarily a subspace of N{A)^ so that 
it is not correct to say that N{An,m)'^ is dense in N{A)^. 

Furthermore, the operators A*An,m and A* will play an important role 
in the subsequent analysis. 

Lemma 10. 


N{An,m) = N{A*An,m) R{A*n^„,A) = R{A*n^J 

Proof. Clearly N{An,m) C N{A*An,m) = N{A*An,m)- Conversely for x G 
N{A*An^m) we have A*QmAPnX = 0, and hence also PnA*QmQmAPnX = 0, 
thus X G N{An^m), which shows N{An,m) = N{A*An,m), and by (fOl) the lemma 
follows. □ 





Using A*An,m and A*A„^m! we have a characterization of the solution op¬ 
erator ^A as a certain nonorthogonal projection operator. 

Proposition 11. For any x € X and any n,m € N, we have the unique de¬ 
composition 


X — Vn^rn '^n,m ^n,m e RiAl^A) 1 ^n,m e N{Al^A). (19) 

Moreover the mapping x —>■ Vn,m is given by i.e., 

'^n,m — 

For any x G X any n, m ^ M, we have the unique decomposition 

X = Vn,m '^n,m '^n,m ^ R{A Aji^rn) ■)'Un,m G N (^A ^n,m) (^0) 

'^n,m G i?(-A 

— '^n,m H“ '^n,m H“ Qn,m eN{Q^A)nx„, (21) 

77 P X-^ 

^n,m ' 

Here, Vn,m,Un,m,Wn,m,qn m Uniquely determined. Moreover, the mapping 
X Vn,m is given by A*{Al^^)\ i.e., 

Vn = A*{Al,^)'^x, 


and the mapping x —)• Wn,m is given by 

Wn,m = njv(Q„^)nx„a;. (22) 

Proof. Define Vn,m = A'l^^Ax, then Vn,m G NiAn^mG = N{A*An,mG = 
R{A^j^A). In particular, we have Vn,m G Xn. Moreover Vn satisfies the nor¬ 
mal equations 


0 = PnA* Qm{APnVn “ Ax) = PnA*QmA{Vn “ x). 

Thus Vn — X € N{A'^^^A) yielding the desired decomposition (fTOl) . Conversely, 
for any other decomposition as above, it follows that Vn G N{An^mG: and it 
satisfies the normal equations. By uniqueness of the minimal-norm least-squares 
solution, if follows that = A\, ^Ax. Thus the decomposition is unique. For 

the second part, define Zn^m = (A^^G^x, then Zn,m G N{A’^^^G = R{An,m)- 
In particular Zn,m G Ym. The normal equation implies that Q^APnA*Zn,m — 
QmAPnX = 0 , thus Vn,m - X = A* Zn,m - X & N {An,m) = N{A*An,m), which 
gives the decomposition. Any other decomposition of the form x = A* An^mP + 
N{An^m) implies that An^mP satisfies the same normal equation as Zn,m and it 
clearly is in R(An^m) = X{A^ mVi ttius by the uniqueness of the minimal-norm 
least-squares solution, we have An^mP = {A^G. Hence, A*An,mP = A*(A’^)G, 
which implies the unique decomposition (EiH) . The decomposition of into 

Wn,m + dnm Gxists by the characterization of N(An,m) in (fTH) and is clearly 
unique since Wn,m is orthogonal to Since Vn,m = A*Zn,m. = A*QmZn,m, it 
follows that Vn,m is orthogonal to N^QmA) and clearly qn,m is orthogonal to 
Xn, hence applying n 7 v(A)nx„ to the decomposition gives the representation for 

I—1 
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Remark 1. This proposition will be used widely; in particular, we recognize 
that Xn,m = element in (fTOl) in the decomposition of and 

thus Xn,m is the result of a nonorthogonal (oblique) projection applied to x^. 
From (USD, (USD we also obtain the nontrivial fact that 

N{Al^^A) n R{,Al mA) = 0, and N{A*An,^) n = 0. 

As a corollary we have a formula for n 7 v(Q„yi)nx„ ■ 

Corollary 12. For any k < n, 

PkAf^;Q^A)nX„ = Pk — ^ki^n,m)\ 

^N(QmA)nX„Pk = Pk - A\,m^k- 

Proof. Applying Pk to (1^ and using the fact that orthogonal projectors are 
selfadjoint and (A^(A* = Al,^^Ak yields the result. □ 

As another illustration of the usefulness of Proposition [Tl] we can prove a 
similar characterization of the space condition (|SD as in Theorem [71 

Proposition 13. We have that is satisfied if and only if 

I lim inf ||a; — m|| = 0 | ==> x G i?(A*) (23) 

\ n,m^oo ’ j 

Proof. Let (l23ll hold and suppose that does not hold. Then there exists a 
X 7 ^ 0 and x G N{A) and x G Hn (-^(^) I”! • For such a x using (ITTl) . (1771) . 

and dD, it follows that for all n limm^oo Wn,m = 0. Thus, by Corollary [17] 
with k = n, 

lim \\{Pn-A*„{A*„ )^)x\\= lim ||(P„ - A], A„,„)x|| = 0. 

m—¥oo m—¥OQ ’ 

Taking n such that ||x — P„x|| < e, we find a m such that 
||x 7 ,.jX|| ^ ||x “t“ ||(Pn 

Thus by (i23ll . since A)) „yA„^m G P(A* „y), it follows that x G R[A*) = A^(A)-*-. 
Since x G N{A), we have a contradiction, thus ([HD must hold. Conversely, if 
([HD holds, suppose that ([MD does not hold. Then we have a a: € N(A) and 
^n,m ^ ^hh \\x ^n,m 0- As = 

^6 have that x-A; „y(A; yyy)''' -An,m 0. Applying P„ to ([HD, it fol¬ 
lows that Wn,m = PnX - A* _„y(A* „j)’''x -An,m 0; in particular lim„ lim^ Wn,m = 
lim„n^(^)nx„a^ = 0. By ([T^, Af^(A)nx,,x is increasing, hence nx(A)nx„a; = 0 
for all n. In other words, x G nyy(Af(A) Cl Using ([7D implies that 

X G A^(A)-‘-, which is a contradiction to x G A^(A). □ 

In view of Lemma El we always have that 

N{A)-^ C {x : dist(x, Af(A„,„)-^) -An,m 0} , (24) 

but according to (1231) . equality holds only if the space condition ([9D holds. The 
corresponding result for the projected least-squares case using A„ (and more) 
has already been proven in [B] . 
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3 Convergence results 

We now study necessary and sufficient conditions for local and global conver¬ 
gence of Xn,m to x\ thus extending the known results of the Section [^?T] 

3.1 Conditions for global convergence 

At first we consider convergence for all xt £ N{A)^. We reprove the statement 
of Theorem [1] based on the following lemma. 

Lemma 14. For all x^ £ N{A)-^ and Xn,m = At Axt, we have 

limsup \\xn,m - a;t|| < limsup ||At ,„A(J - P„)xt|| 

71,771—^00 71,771—¥00 

Proof. Noting that At = I - njv(A„,^) = nAr(A„,„).L = 

Xn,m - xt = At ,^Axt - xt = {A\^ „^QmAPn - I)x^ + A\^ „^QmA{I - P„)xt 

= -(1 - nfl(A.^^))xt -h At _„A(J - P„)xt. 

Thus we have 

Ikn.m-xt|| < inf ||xt-z||-h||At A(/-P„)xt|| 

Now, Lemma inland (fTSl) yields the result □ 

Remark 2. In the above result we can easily replace At ,^A{I — P„)xt by the 
expression At ,„Q„Anjv(Q„A)i (/ - P„)xt or by At ,„Q„A^^(Q^^)inx,^a:'''■ 

We obtain the first (well-known) result on global convergence; cf. Theoremll] 

Theorem 15. The approximations Xn,m converge to xt for all xt £ N{A)-^ if 
and only if there exists a constant C such that 

sup ||At ,„A|| < C. (25) 

71,771 

Equivalent to (ESI is that there exists a constant C such that 

sup ||At ,„A(J - P„)|| < C. (26) 

71,771 

Proof. Let Xn,m for all xt £ V(A)-*- as m,n —>■ oo. Then we have by 

Xn,m = At ,„Axt that At „jA —)• I pointwise on 7V(A)-*-. By the uniform bound¬ 
edness principle this implies that At must be uniformly bounded. 

But it is easy to see that this is equivalent to (1^ . 

Conversely let (1^ hold, then 

||At,„A(/-P„)xt|| < \\Al^A\\\\{I-P„)x^l 

and by (1^ and (El, the first result follows. Since At A(/ — P„) = At „jA — 
At ^An,m, and Aj) ^An^m is always bounded, (1^ follows. □ 
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Next, we study condition (1251) in depth and rewrite it in other forms. Clearly 
it holds that 

sup \\Al^A\\ < C o sup \\A*iAU^\\ < C. (27) 

m,n m,n 

We show that (1^51) is equivalent to the fact that angles between certain subspaces 
are uniformly bounded. More precisely, we consider the norm of the product 
of orthogonal projectors onto two subspaces, which is related to the (minimal 
canonical) angle; cf. [331 Lemma 5.1]. 

Lemma 16. For a sequence of closed subspaces X^Yn, let be the 

corresponding orthogonal projectors. 

Then we have the following equivalent conditions 

< 1 : sup ||nx„ny„|| < p, (28) 

n 

o3r > OVx e X„,i/e : ||(a; + y)|p > T||a:|p, (29) 

<t^3r'> OVa: e W„,?/e : ||(a: + j/)|p > t||j/|P. (30) 

Proof. If (1331) holds, then by Young’s inequality for any e > 0 a: € y € F„, 

||(x + y)f > ||x|p + hr - 2pM ||y|| > ||xf (1 - pe) + ||yf (1 - f). 

With e = p or e = p~^ either of (1501) or ((30)) follows. Conversely let (130|) hold, 
then then for any x S y € yn with ||a:|| = ||j/|| = 1 and any e > 0 

eV < Ijea; + -yjl^ = + 4 “ 2(a:, y). 

e 

Taking = (1 — t^)“ 5 gives the bound 

2(a^,y) <2(l-p2)i <2, 

thus with (cf. [331 Lemma 5.1]) 

Ijn^nvll = sup (a:,y), 

||x||<l.||y||<l.xeX.yeF 


the result follows. □ 

Combining Proposition [TT] and Lemma HOI yields the following 
Theorem 17. The uniform boundedness condition ([33]) is equivalent to one of 


the following (and hence 

all) conditions: 


3?7 < 1 : Vn : 

1 njv(.4* ,„A)LI_r(A* ,„.4) < V, 

(31) 

3?7 < 1 : Vn : 


(32) 

3?7 < 1 : Vn 

: Wh - Pn)^R(A-A„,^)\\ < V- 

(33) 


Proof. The boundedness condition can be rephrased as the condition that a 
constant C exists with (using the notation in Proposition [TT]) 

||'Cn,m|| ^ “ CjlUyi,??! 3“ ^n,m||- 
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for all Vn,m & Un,m £ However, thls is (1^ with 

the spaces N{A'!^ j^A) and i?(A* thus Lemma [TBl gives (IHTl) . By (E71) we 
have the equivalent characterization of uniform boundedness using (HH) that a 
constant exists, such that 


which yields (l32ll . By (|30)) . this is equivalent to the existence of a constant such 
that 

+ < C'||a;||, (34) 

with Wn,m, Qnm S'® in Proposition [TT] However, Wn,m is always uniformly 
bounded for bounded x by (|2^ . and it is orthogonal to qn,m- Thus, this condi¬ 
tion is satisfied if and only if 

Ikn.mll C = C (11^71,■m+9„,m+'n'„_rn II ) = C (ll^n,m+9„,m II +ll'n’n,m|| )■ 

Since we can take x = Vn,m + 9n m + ^n,m with arbitrary chosen elements 
Vn,m,qn mi^n,m out of the Corresponding spaces, we have that (IMl) holds if and 
only if for all Vn,m G R{A* An,m) and all G 

||9n,m|| ^ C (11^71,m + <ln,m\\)^ 

which is equivalent to dSSl)- □ 

Remark 3. We remark that for closed subspaces X , Y , in Hilbert spaces the 
identity Hn^HyH < 1 <=> ||nj 5 fj_nyj_|| < 1 usually does not hold Eiii]. 

These conditions can be rewritten in more convenient form. 

Theorem 18. The uniform boundedness condition ()25l) is is equivalent to one 
(and hence all) of the following conditions: 


3C > 0 : Vn, m, x 
3r] < 1 : Vn, m, x 
3r] < 1 : \fn, m, w 

3r] < 1 ■. Vn, m, v 


11(1 - Pr,)A*QmAPr,x\\ < C'\\PnA*Q^APr^xl (35) 
II(J - Pr,)A*QrnAPr,x\\ < 77||H*Q,„HP77a:||, (36) 
inf \\Pr,A*Q^Aw - A*QmAPr,v\\ < r 7 ||P 77 Vl*Q 7 nAn;||, (37) 

V 

inf \\Pr,A*QmAw - A*QmAPr,v\\ < p\\A*Q^APr,v\\. (38) 

w 


Proof. Condition (IMll can be rewritten as (1361) . By splitting the terms using the 
complementary orthogonal projectors P and I — P, it is easy to see that this is 
equivalent to (1551) . The identities (1571) and (155)) are m and (1551) . respectively, 
when writing the projectors onto the nullspaces as complementary projectors 
onto the ranges of the adjoints and using the minimization property of such 
orthogonal projectors. □ 

It is not difficult to verify that (1551) is equivalent to Vainikko and Hamarik’s 
condition ©■ Note that a characterization over angles of subspaces has also 
been used by Du and Du [SI Theorem 1.2] for the case Qm = I and with different 
spaces, which do not yield an equivalent condition to (jS)) but need additionally 
the space condition 
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3.1.1 Necessary and sufficient conditions for convergence 


In this section we investigate practically useful conditions such that (pSj) is 
satisfied and necessary conditions for (Eg. 

We hnd a condition of Natterer’s type that is equivalent to the uniform 
boundedness condition extending Natterer’s result to the cases of non-injective 
operators and Qm ^ I- 

Proposition 19. The uniform boundedness condition (1251) and hence Xn,ra 
x'' for all x^ G iV(Gl)-*- holds if and only if there exists a constant C such that 
for all x"^ & X there exists a Un & Xn such that 

||crt-u„|| + |K^A(crt-u„)|| <6-11x^11. (39) 

In particular for the case Qm = I, if Natterer’s condition ([7]) holds for all 
x'^ € iV(yl)-*-, then (1751) holds, thus x„ —>• x^ for all G N{A)-^. 

Proof. If (^51) and hence global convergence holds, then u„ = Xn,m satisfies (15^ . 
Conversely if (1551) holds, then since QmAun = An,mUn 

— \\^n,mQmA(x — Un)\\ + || || 

< \\Mi,mMx-Un)\\ +Ci||u„|| 

< \\A\^^A{x - u„)|| + ci||u„ - x'I'll + cillx'l'll < C'llx’l'll. 

It is easy to see that © implies (P|) . □ 


From the conditions (ESI)-®, probably ® is the most useful. We intro¬ 
duce the norm of the pseudoinverse of the discretized forward operator 


UlJl = 


^miniQmAPn) xdPn.Qm^PnX^C) PnA^QrnAPnX^ 


(x,x) 


where (Tmin denotes the smallest (by definition nonzero) singular value. We have 
the following result: 

Lemma 20. If there exists a constant C such that 

\/n,m \\iI-Pr,)A*Q,^\\\\AlJ\<C, (40) 

then and hence is satisfied. 

Proof. In view of (155)) . we observe that 


\\PnA*QjnZ\\ > CrniiniQmAPn)\\z\\. 

Taking 0 = APnX and ||(/ - Pn)A*QmAPnX\\ < ||(/ - Pn)A*Qm\\\\Q7nAPnX\\ 
proves the assertion. □ 


Note that this result implies in particular Theorem 0] In the same way we 
could prove the result by replacing dSni) by 

Vn,m \\{I-P^)A*Q^A\\\\AlJ\^<C. 

Natterer m has outlined how to prove conditions like in practical 
situations, namely from inverse inequalities of approximation spaces combined 
with error estimates for the approximation. Using (gni) we can do a similar 
thing. 
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Proposition 21. Let {Hg, ||a:||s)sgR be a Hilbert scale generated by a densely 
defined unbounded selfadjoint strictly positive operator L, i.e., 

\\x\\g = Wx\\. 

Suppose that A : Hq — Hq is such that for some numbers l,r > 0 

ci||a:||_i < ||Aa;||i 2 < C 2 ||a:||_r Vcc e iJo, (41) 

and that Xn is a discrete subspace satisfying the approximation condition 
11(1 - P„)z|| < 7„||2:||i yzeHi, 
and the inverse inequality 

Pn 

holds. Then if 

lim sup ^ < C, 

n Pn 

the uniform boundedness condition (1251) holds. 

Proof. We have that 

||AP„a;|| > ci||P„a;||_i > ciPn\\Pnx\\. 


Thus, 

II 

ClPn 

Moreover with z = A*x we find that 

||(/-P„)24*a;|| <7„P*x||,. 

From the right hand side of dUD, we see that AL'^ is a bounded linear operator 
and so is its adjoint L'"A*, i.e., ||^*x||r. < C||x||. Thus (HHll is satisfied by 

\\{I-P^)A*x\\\\Ai\\<C^<C. 

Pn 

□ 

In a typical case of finite-element spaces or spline spaces and if we consider 
a Hilbert scale of Sobolev spaces, then the inverse inequality is usually satisfied 
with /3ri = j and the approximation condition with 'yn = :^. Thus if r = Z is 
applicable, then we obtain convergence. A similar argument has been utilized 
by Natterer using condition ©• 

The next result concerns the dual variant of (1551) . 

Proposition 22. If 

3 : ?7 < 1 : Vn : \\PnLl]sr(Ai^^A)\\ < (42) 

then (EH) is satisfied. Moreover, (1421) holds if 

3:r]<l:\/n,\/w: inf ||A*(5,.„AP„z; - P„u;|| < ? 7 ||P„ri;||. (43) 

V 
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Proof. Inequality can be written as 

V > l|nAr(A* = ||(^ — ^R(A-Ar,^r„))Pn\\- 

By the characterization of orthogonal projectors as minimizers we have that this 
is equivalent to 

- Pnx\\ < v\\Pnx\l 

V^R{A* Ar,,m) 

which is exactly (H51) . Setting x = A*QmAw we obtain that this implies (1571) . 

□ 

Note that (HTll is not equivalent to (ITKll because (HTll can only hold if the inter¬ 
section of the corresponding spaces is empty. However, if D fV(H* ^A) 0, 

then (H7)) cannot hold but (1251) still can. 

Let us now come to a necessary condition for uniform boundedness. We 
show that the uniform boundedness (ITS]) implies the space condition ([^ . In the 
case Qm = d, this has already been observed by Du [S]. 

Proposition 23. Let ((751) hold, then 

f]{NiA)nX„)^ =N{A)^, 

n 

i.e., the space condition holds. 

Proof. Since U„(^(^)nX„) c N{A) it follows that N{A)^ c f]JN{A)nXn)^. 
Thus, we only need to proof the opposite inclusion. Let x 
In view of (HZD we have that for all n, 

Jim^ ||x - n(jv(Q^A)nx„)^a.|l ^ 0, 

thus using (17T1) for x, we have that 

Vn : lim Wn,m = 0. 

m—foo ’ 

By cm, we have that the double sequence ||w„_m|| is decreasing in m for all n. 
Since 

ll^ll = ll'*i'n,'m|| A \\'^n,m A <ln,m\\ ) 

we have that for all n, + 9nmll i® increasing in m and that 

limm-s.oo Un.m + = xf. Thus for all n, sup^ \\vn,m +7„,mll = x^, and hence 

\\vn,m + 9n mil is bounded uniformly in n, m. Since (1751) implies (1551) using (1551) . 
we have a constant C such that 

Il7„,mll < C\\Xn,m+qn,m\\ < ^1^11- 

Thus, ||g„ ^11 is uniformly bounded, it has a weakly convergent subsequence as 
n,m ^ oo, and as qn,m G Xn^ if follows that this limit can only be 0. By a 
subsequence argument we conclude that wliin„^m^oo7ra m = 0. It follows that 
the iterated limit wliin„_j.oo (wlinim->.oo7n,m) = 0- Thus, 

X = wlim I wlim Vn,m 

n—)-oo ym—>cxD 

Since each Vn,m is in 7 V(g 1)-’~, and this space is weakly closed, all the limits are 
in N{A)-^ as well, thus x G N{A)-^. □ 
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3.2 Conditions for local convergence 

We are now interested in local convergence results, i.e., to study the question 
if for a given a specific element G N{A)^ the corresponding sequence Xn,m 
converges (weakly or strongly). The difference to the previous section is that 
the conditions imposed here are not “uniform” in x^ but depend on the specific 
a;b 

A practically useful sufficient condition for strong convergence is a simple 
consequence of Lemma [U] (compare Theorem U]). 


Proposition 24. If 


lim ||A)j™||||A(/-P„)a;^|| ^0, 


m.n—^oo 


then Xn,m —t as m,n ^ oo. 

Hence if can be approximated well in Xn, we can hope for strong conver¬ 
gence. This result is quite crude compared to TheoremjSl where (except for weak 
convergence) equivalent conditions to convergence are established. However, the 
mentioned theorem of Groetsch and Neubauer (with the supplementary result 
of Du) can also be extended with minor modifications to the case of Qm I- 

Theorem 25. We have the following local eonvergence conditions for strong 
convergence. 

Xn,m -t limSUp \\Xn,m II <11^^11- (44) 


Suppose that the space condition (O holds. Then we have the following local 
convergence conditions for weak convergence. 


rt 


sup ||a;„,m|| < oo. 


Proof. Consider first the part on weak convergence. By boundedness, Xn,m has 
a weakly convergent subsequence with limit u. As in [9] it follows immediately 
that u — x^G Moreover each a;„,m € {N{QmA)nXn)'^ C (A^(A) flXn)-*-, 

thus Xn,m G (A^(A)nAifc)-*- for all k > n. This implies that u G n„(Af(A)nAr„)-‘-, 
and by Q, u G N{A)-^. Thus u — x^ G N{A) n A^(A)-*-, hence u = x^. By a 


subsequence argument, Xn,T, 


L For (H^ . we do not need 


The proof 


follows [5] : from dMl), we again find a weakly convergence subsequence with 
limit u and u — x"^ G N{A) and G N{A)-^. Thus, 

||u - -f llx'i'lp = ||u|p < liminf ||a;„,m||^ < limsup Wxn^mW^ < ||a;'l'|p. 


thus u = x^ and as before Xn,m x^. From dm) we also find that ||a;n,m|| ^ 
||a;t||, which together with weak convergence implies strong convergence. The 
other directions of the implications are trivial. □ 

In a next step, we replace m by other “local” conditions. 

Lemma 26. We have that 


rt 


lk„,m|| < OO and 
N(A)Xn,m ^ 0- 


sup„,„ 

H 


(45) 
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Proof. Suppose that Xn,m converges weakly to Then for arbitrary z 
lim {IlNtA)Xn,Tn,z) = lim ix„^rn,^N(A)z) 

71,171—^00 71,771—¥00 

= lim {Xn,m - X^ ,IIn(A)z) = 0, 

71,771—f-OO 

where we used that (a;'!’,n 7 v(A)^) = 0 as € N{A)-^. Conversely, let Xn, 7 n 
be bounded and njv(A)a^n.m ^ 0. As in the proof before, Xn,m has a weakly 
convergent subsequence with limit u such that u — x^ € N{A). Thus with z = 
u — x^ we have that 


0 = \im{IlN(^A)Xnk,fnk,u - x^) = lim(xnj,, n7v(A)(« “ a;''')) 

k k 

= hm(x„j^,mfc - x'l',niv(A)('w - a;''')) = ||u - x^'lp, 

thus u = x’f. By a subsequence argument Xn,m x^. □ 

As a consequence, we can find sufficient conditions for weak and strong local 
convergence generalizing the results of Luecke and Hickey. 

Proposition 27. Suppose that with some fixed constant C, there exists for 
each n,m an index pair {'rhn,m,hn,m) G N x N with lim„_m->oo fin.m = cxd, and 
rhn.m > an, and hn,m £ ai, such that 

sup ||x„,m|| < C and sup || < C . (46) 

71,771 71,771 

Then Xn,m ^ as m,n ^ oo. 

If we can choose (rhn,m,hn,m) = (aa,an), i.e., 

sup ||x„,m|| < c and sup ||A*(A*_„)'''x„,m|| < C, (47) 

71,771 71,771 


then Xn,m ^ x’f as ni,n ^ oo. 

Proof. We apply ©D and get for all n, m 




yxr, 


Wm. 


^rh. 


By it follows that +9m„ „ n„ ^ uniformly bounded, and since 

these two elements are orthogonal to each other it follows that both components 
are uniformly bounded as well, hence they have weakly convergent subsequences 
as n, m —oo with limit w, q. 

For fixed k, Puq = whm^ m ~ ® since hn,m —>■ oo, and thus 

it follows that q = 0. Since Xn,m S {,N{Qm^ ,^A) n A„)^, for > an, and 

(A^(Qm„,„.A) n A^)-*- c (A((5a„ ,„A) n Afi„ ,^)-‘-, we have that = 0. 

Thus we have for a subsequence 


wlim 

k—¥oo 




A* {A* 


nk,mk 


) 


= 0 . 


By a subsequence argument we have that this holds for the whole sequence. 

,vlim {Xn^rn A (A,^^ mWn m) Xn,m) — 0- (4^) 

77,771—^00 ’ ’ ’ 
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It follows that 


^N{A)^n — ffw (A) m ,^ti m) ^n,m') ^ 0? Q'S ?7Z, 71 ^ OO, 

thus, by (USD we obtain the result that Xn ^ x^ as m,n ^ oo. Since (F7|) is a 
special case of dUl), we have that under dUl), Xn,m converges weakly to x^ and 
furthermore by (P|) also that A* Xn,m ^ as m,n —>• oo. Thus, by 

weak convergence, 

lim \\xn,ni\\'^ = lim (A*{A*^^)^Xn,Tn,x'\={x\x'^) = \\x^\\^. 

n^m—¥OC 71,771—^00 \ ’ / 

By the Radon-Riesz property, we obtain that \\xn,m — x’^|| —>■ 0. □ 

Remark 4. Proposition \2'll\ includes Theorem\^as a special case. Indeed, setting 
Qm = I, from (fTTl) . the boundedness of Xn and ||A*(A* )^x„|| follows immedi¬ 
ately, and thus by (SZl) we obtain Theorem H as a corollary. 

4 A counterexample 

In this section we provide a nontrivial example of a sequence of projected least- 
squares solutions, Xn, which is bounded but non even weakly convergent. Note 
that Du’s example considers a similar situation but the sequence Xn is strongly 
convergent (but not to x^). The example again stresses the importance of the 
space conditions m and the fact that the part on weak convergence in Theo¬ 
rem [5] is false without the space condition 

Theorem 28. There exists an operator A and x^ and a sequence of finite¬ 
dimensional spaces (Xn)n satisfying Q such that X 2 n u but X 2 n -ft u and 
X 2 n+i r, but X 2 n+i 7 ^ V and u,v ^ x^. In pariicular the sequence x„ neither 
converges weakly nor strongly and it has no weakly convergent subsequence has 
limit x^. 

Proof. Let X be a separable Hilbert space with orthonormal basis Cij, {i,j) S 
N X N, i.e., all elements x G X may be represented via 

OO OO 

||x|p = < °° ■ 

= l ij'=l 

We define a linear bounded operator A-. X ^ X via 

OO OO 

Ax := 'y ( y 'X ^ij T , 

i=l i=2 

where q £ (0,1) is fixed. Obviously, 

OO OO f 4. 

^ 2maxi 1, ^ ^ ^ 

i=l j=2 ^ ® 

It is easy to see that A has an infinite-dimensional nullspace. It holds that 

OO 

X G N{A) Vi > 1, j > 1 : ^ij = -q^^^l and ^ < 00 . (49) 
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A generalized solution a;^ = A^y of the equation Ax = y is always an element 
of -/V(A)-*-; we may characterize these elements as follows: 

OO 

oo '^*1 and 

z = ^ e N[A)^ <;=^ Vz > 1 : oo oo'^^^ ■ (50) 

i=l j=2 

Now we choose finite-dimensional subspaces of X : 


Xn := spanje^ : 1 < i, j < n}. 

Obviously, ([S]) holds. Let S N{A)^ with x^ = J2Tj=iCij^ij ^ N{A)-^ and 
y := Ax^, and set Xn ■= Al^y, where A„ := AP„. 

Since, due to (H!B . N{A) 0 A„ = {0}, we get by (fHll that N{An) = X^. 
Therefore, 

n 

Xn= 

i,t=l 

is the unique minimizer in A„ of the problem 

OO OO 

||Ax„-?/f = -Cq)+9^(G-C*i))^ ^ min, 

i=l j=2 

where := 0 if z > n or j > n. 

From the first order necessary conditions for a minimum we obtain the so¬ 
lution: 

Cj = Cij if 1 < i < n , 2 < j < n , 

and 

( OO 

E 

j=n+l 

OO 

= Gi + (1 - E , 1 < z < n . 

3=0 



Now we choose a concrete element x"'' € N{A)^: 


Cij ■ — 


1-q- 


■ {apj+nj), z>l, j>l. 


with 


Pj ■= 


1, j even, 
0, j odd, 


Tii ■■ = 


1, j = i + 1, 

0, else, 


^ < oo , (52) 




and the extension dsol) for J = 1. The condition on the coefiicients Ci guarantees 
that 


OO OO 


EECc 

i=l 3=2 


< OO . 
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It then holds that 


Qi = Cil + CiCn + r^^n +1 with 

S-n ^ ^ g ^Pn+l+j ■ 

(53) 


3=0 



Noting that 




1 U\ 

n even, 

n odd, 


(54) 

(15^ implies that 




lim = Gi + 

L—¥oo 

to 


(55) 

l-g4’ 


hm = C.i + 

l—¥CO 

Ci 


(56) 

l-g4- 


Let us now define the two elements 




00 

00 



u := UijCij and 

V := UijBij 



ij'=l 

* ,1=1 



with 




■ — Szl “T ^ '^ij •— ^ij 

1 

1 

J > 1, 


Vil •— Qil “h ^ Vij •— Qij 

1 

1 

J > 1- 


Obviously, due to (H51) and (P| , u — cc'*' and 

V — x^ € N{A), and thus u 

and V 


are least-squares solutions of Ax = y = Ax^ with u,v ^ x''. Together with (15^ . 
(PI). and (PI we immediately obtain that (remember that Xn = A\y is given 
by dnH, ([53|) 


^4 _ „2n+2 

11 ^: 2 / - P2in\\^ = -;-^- = \\X21+1 - P2l+iv\\‘^. 




(57) 


Now (1551) and (pi) imply that 


X2l ^ U, X21+1 V , 

but (ipi implies X21 u and X21+1 v. Thus, it is possible that Xn has different 
weakly convergent subsequences, but it neither converges weakly nor strongly 
towards x''. □ 


5 Conclusion 

We have studied global and local convergence of general projection schemes for 
ill-posed problems. For global convergence, we have established the uniform 
boundedness condition (EB as being necessary and sufficient and have found 
concrete conditions in Theorems ITTI and ITSl when this holds. Several practically 
useful sufficient condition were given in Section 13.1.11 Concerning local conver¬ 
gence, we have generalized the well-known results of Groetsch and Neubauer and 
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Du giving an equivalent characterization of local convergence by norm bounds 
in Theorem [53 Further sufficient conditions of the type of Luecke and Hickey 
were given in Proposition 1271 

In the analysis, we point out two important findings: the recognition of 
the Xn,m as oblique projection of a;i, which leads to a study of angles of a se¬ 
quence of subspaces. The second point is the question if the intuitive identity 
= Yvaim.n N is valid, understood in the sense as (IMl) . As the 
inclusion “C “ always holds, this gives a way of applying the uniform bounded¬ 
ness principle. However it is important to notice that this identity does only 
hold unless the additional space condition holds. While for injective oper¬ 
ators this is trivially true, for noninjective operators (|9l) has to be taken into 
account when studying local (weak) convergence. 

The issue that this condition is needed for weak convergence is illustrated 
by a nontrivial counterexample in Theorem [55] of a bounded sequence Xn which 
does not converge at all, thus generalizing the examples of Seidman and Du. 
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